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EXTERNALLY CUSTOMIZED TONAL-HIERARCHY CONFIGURATION AND 



2 COMPLEMENTARY BUSINESS ARRANGEMENTS, FOR INKJET PRINTING 

3 
4 

5 RELATED PATENT DOCUMENT 

6 

7 A related document is another, coowned U. S. utility- 

8 patent document hereby incorporated by reference in its 

9 entirety into this document. It is in the names of Joan 

10 Manel Garcia-Reyero et al . , first filed as application 

11 serial 09/516,007, later converted to provisional 60/- 

12 , , and then made to form a basis of a nonprovisio- 

13 nal application / , , "IMPROVEMENTS IN AUTOMATED 

14 AND SEMIAUTOMATED PRINTMASK GENERATION FOR INCREMENTAL 

15 PRINTING", and issued as U. S. Patent 6, , and 

1 6 several earlier documents cited therein . 
17 

18 

19 FIELD OF THE INVENTION 

20 

21 The invention relates generally to novel machines, 

2 2 operating procedures, and combinations of business proce- 

2 3 dures therewith, for incremental printing of text or 

2 4 graphics on printing media such as paper, transparency 

2 5 stock, or other glossy media, and myriad specialized 

2 6 surfaces ranging from virtually unabsorbent of ink to 

2 7 extremely absorbent; and more particularly to distributive 

2 8 industrial arrangements for implementing an especially 

2 9 versatile mechanism that accommodates the absorbencies and 

30 other idiosyncratic properties of those specialized sur- 

31 faces. 
32 

33 
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1 BACKGROUND OF THE INVENTION 

2 

3 (a) Modern improvements in management of patterning 

4 and grain — The Garcia invention mentioned above, to- 

5 gether with previous related work, has brought to ink jet 

6 printing a remarkable, unprecedented degree of 

7 systematization and orderliness in the control of 

8 printmasking for suppression and balance of both pattern- 

9 ing and random granularity . Those developments have 

10 created an opportunity for ready expansion of Inkjet 

11 printing into many new applications that entail printing 

12 on a great variety of special-purpose printing media. 
13 

14 (b) The challenge of specialized print media Such 

15 special purposes and their associated printing media may 

16 range from metal-foil-like materials, through bulk-matte 

17 synthetic papers, to extraordinarily porous fabrics or 

18 membranes. They are in fact so great in number that it is 

19 impractical for major manufacturers of ink jet printers — 
2 0 particularly large, printer/plotter-scale units suited for 
21 industrial use — to give adequate attention to the unique 
2 2 inking requirements of such diverse industrial materials. 
23 Unfortunately for the resolution of this problem, 

2 4 conventional printing systems have factory-established 

25 fixed relationships between the data manipulations neces- 

2 6 sary to image rendition and the colorimetric tone hierar- 

2 7 chies produced by actual ink on actual printing media. 

2 8 Such fixed relationships are essentially taken for granted 

2 9 in the industry. 

30 Rendition calculations — particularly but not exclu- 

31 sively dither masking for commercial graphics, and error 

32 diffusion for photo-like and other continuous-tone images 

33 — are very well known in this field and extensively 

34 disclosed and discussed in dozens if not hundreds of 
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1 patents on this subject. The later processing stage of 

2 printmasking is also very well elaborated in the patent 

3 and other literature, perhaps culminating in the Garcia 

4 innovations . 

5 

6 (c) Early partial responses to the challenge , and 

7 their limitations — Inkjet printers exhibit various ap- 

8 proaches to accommodating diverse inking requirements . 

9 Common to substantially all these, however, is internal 

10 control, by the printer manufacturing company, over the 

11 above-mentioned relationships between rendition processing 

12 (and printmasking) and the tone hierarchies in the low- 

13 level output printing stage. 

14 On one hand such control is extremely beneficial, 

15 because these relationships — while in most cases decep- 

16 tively appearing simple and straightforward — are often 

17 inordinately demanding of attention from ink chemists, 

18 color scientists, and advanced programmers. The printer 

19 manufacturer' s personnel may be best equipped to deal on a 
2 0 large scale with such problems. 

21 On the other hand, many special printing materials 

22 are employed in relatively very specialized industries 

23 that cannot support more than a few large-format printers. 

24 Such industries may be popularly described as "niche" 

2 5 operations in that they cater to manufacturing or other 

2 6 industrial activities which are important in their own 

27 environments but virtually fit into mere small recesses in 

2 8 the overall industrial woodwork. 

2 9 In such circumstances it becomes uneconomic for key 

30 personnel of an extremely large manufacturer to attend to 

31 such special needs on an individual basis. This problem 

32 is exacerbated by the relative ungainliness and large 

33 overhead associated with activities of a printer manu- 

3 4 facturing firm. 
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1 (d) Advent of the nimble RIP — In recent years, the 

2 special needs and challenges of some of these niche appli- 

3 cations have been undertaken, and very advantageously so, 

4 by companies that do not manufacture printers, or comput- 

5 ers either — but rather manufacture a new kind of device 

6 known as a raster image processor. Such a special -purpose 

7 processor has most commonly taken the form of a physically 

8 separate, and separately manufactured and marketed, elec- 

9 tronics module that takes on image-manipulating chores 

10 previously performed in the computer or printer, or both. 

11 In many cases the processor justifies its existence 

12 simply by relieving the general-purpose computer of time- 

13 consuming massive computations, freeing that more versa- 

14 tile computer for a variety of other tasks more demanding 

15 of its general abilities. In other applications, however, 

16 the processor serves a higher purpose: 

17 A relatively smaller company that manufactures raster 

18 image processors, by virtue of the greater economic and 

19 operational agility that goes with lesser size, is much 
2 0 better suited to address the science and engineering 

21 requirements of printing in a niche industry. Thus the 

2 2 processor company can be nimble enough to serve a need and 

2 3 make an attractive profit from operations that would be 

24 impractical for a printer company. 

25 

2 6 (e) Remaining limitations — Yet a partial obstacle 

27 to this solution remains. Conventionally, as mentioned 

28 above, the printer company — and the printer itself — 

2 9 provide to the outside world only a fixed relationship 

30 between rendition math and output tonal hierarchies. 

31 This means that a processor company, having once 

32 determined that a special relationship is needed, must 

33 still beseech the printer company for installation of a 

3 4 custom ROM, or PROM, or in some cases an even more thor- 



1 oughly buried functionality, that defines the rendi- 

2 tion/output mapping. The last-mentioned situation may be 

3 typified by a need to circumvent a fixed operation built 

4 into an application-specific integrated circuit ("ASIC") 

5 that is a sort of hypothalamus in the printer. 

6 Although in most situations an identifiable module 

7 containing the necessary mapping function is actually 

8 present in the printer, yet the problem remains because 

9 that module is relatively inaccessible to the processor 

10 company. Furthermore its syntax may be incompletely plain 

11 to even skilled programming personnel of the processor 

12 company. 
13 

14 (f) Known distributive tonal -hierarchy schemes — 

15 Nevertheless the raster image processor ("RIP") has earned 

16 a rightly established place in the Inkjet printer indus- 

17 try, so much so that a current generation of some printer 

18 products includes a RIP that is essentially built in. 

19 This type of arrangement represents one new kind of part- 
2 0 nering among business entities: in this case, for pur- 

21 poses of this document, the RIP manufacturer in practical 

22 effect (though not in legal effect) becomes a part of the 
2 3 printer company. 

24 Here the RIP is very loosely an "internal RIP". The 

25 two companies are termed "affiliated". 

2 6 Where a processor is instead sold separately, for 

2 7 purposes of this document the processor is called either 

2 8 simply a "processor" or an "external RIP" — and in prac- 

2 9 tical effect the processor manufacturer does not become 

30 part of the printer company, and the two are termed "unaf- 

31 filiated". The processor may most typically be installed 

32 by the end-user, or alternatively by a representative of 

33 the processor company; merely for purposes of this docu- 

34 ment, such an arrangement is not termed "partnering". 
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1 Both these kinds of distributive arrangements for 

2 managing tonal hierarchy have been classically known, at 

3 least in diverse industries , as "OEM" or "original-equip- 

4 ment manufacturer" situations. In some industries, only 

5 one or the other would be regarded as truly OEM. 
6 

7 (g) Conclusion — This discussion has focused upon 

8 limitations in the ability of both a printer company and a 

9 processor company — either one acting alone — to fully 

10 deal with needs of specialized printing applications. 

11 These limitations continue to impede achievement of uni- 

12 formly excellent inkjet printing in greatly diverse indus- 

13 tries. Thus important aspects of the technology used in 

14 the field of the invention are amenable to useful and 

15 important refinement. 
16 

17 
18 

19 SUMMARY OF THE DISCLOSURE 

20 

21 The present invention introduces such refinement. In 

22 part it does so by introducing new kinds of partnering 

23 among unaffiliated business entities; and in part it does 

24 so through a new kind of printer interface that accepts an 

25 externally defined drop table for converting plural -bit 

26 data from the end of a data pipeline to a specific number 
2 7 of dots per pixel. 

2 8 In preferred embodiments of its first major independ- 

2 9 ent facet or aspect, the invention is a printing system 

30 for printing an image based upon input image data. (The 

31 image data is not itself an element of the invention, but 

32 is rather a part of the environment or context of the 

3 3 invention . ) 
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1 The system includes a printer manufactured by a 

2 printer company. Throughout this document the phrase 

3 "printer company" represents a complex of concepts includ- 

4 ing a company which manufactures printers; or one or more 

5 companies which affiliate or contract together to do so — 

6 in such a fashion that the finished printer can be sold as 

7 a unit by one or more of the companies . 
8 

9 The printer may (it does not necessarily) include a 

10 raster image processor ("RIP") , which if present may for 

11 example be (but is not necessarily) within the printer. 

12 For purposes of general verbal shorthand, such a RIP will 

13 be called very loosely an "internal RIP". As will be 

14 seen, it might equally well or better be called a 

15 "printer-company- &-aff iliates RIP". 

16 T1 "*s for example the phrase "printer company" encom- 

17 passes a business collaboration or consortium that in- 

18 eludes a company which programs and/or makes a RIP for 

19 sale with the printer, together as a unit. Again, such an 

20 "internal RIP" — if present at all — may be but is not 

21 necessarily within the printer. 
22 

23 The printer has a native resolution. The system also 

24 includes a raster image processor that is manufactured and 

25 programmed by one or more processor companies, different 
2 6 from the printer company. 

27 Also throughout this document this phrase "processor 

2 8 companies, different from the printer company" means 

2 9 companies that do not collaborate as described above to 

30 furnish a RIP which is sold as a unit with the printer. 

31 As a verbal shorthand, this processor will be called 

32 simply "the processor". Unlike the internal RIP described 

33 above, the processor is a necessary part of this first 

3 4 aspect of the invention. 
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Usually, but not necessarily, the processor under 
discussion here — in contrast to the RIP introduced 

earlier is external to the printer. The processor 

therefore may also be called very loosely an "external 
RIP" . 

Thus the system may include an "internal RIP" pro- 
vided by the printer company with affiliates; and does 
include "the processor", which is an "external RIP" pro- 
vided by a third party — i. e. not the printer com- 
pany/affiliates and not the end-purchaser/user, but a 
third party or plural such parties. This unit thus might 
equally well or better be called a "third-party RIP". 

Central to the present invention is the idea that the 
processor companies are third-party vendors, not affili- 
ates of the printer company but rather independent enti- 
ties selling their RIP products directly to end-users or 
directly to retail outlets — separately from, but for use 
with, the printer. This characteristic considered alone 
is neither novel nor unique, but is so when considered 
together in conjunction with other elements of the combi- 
nation described here. In addition to being novel and 
unique, this characteristic within the present combination 
is an extremely powerful and useful feature as will short- 
ly be seen . 

The processor processes such image data and transmits 
processed image data to the printer. The word "such" is 
used here in place of "the" or "said" to flag the image 
data, again, as not an element of the invention but rather 
something most typically provided by the end-user. 

Also included in the system is a two-bit data pipe- 
line carrying such in-process data through at least part 
of the processor. The concept of a data pipeline is well 
known to people who have ordinary skill in this field; and 
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1 the phrase "two-bit" indicates literally that the data 

2 pipeline carries two individual binary bits of independent 

3 digital data for each picture-element (pixel) position in 

4 the corresponding image. 

5 As is well known, two data bits may assume any of 

6 these four conditions : 

7 first second 

8 bit bit 

9 0 0 

10 0 1 

11 10 

12 1 l. 

13 

14 Considered together, each of these bit pairs of course 

15 forms a two-bit binary number whose values can be written, 

16 in binary, as "00", "01", "10" and "11". It is equally 

17 well known that these four binary values correspond to 

18 decimal "0", "1", "2" and "3" respectively. 

19 The system also includes a drop table for converting 
2 0 such data from the pipeline to the native resolution of 
21 the printer. The phrase "drop table" refers to drops — 

2 2 or resulting individual dots — of colorant, such as ink, 

2 3 respectively projected toward or formed on a printing 

2 4 medium, to construct the image. 

2 5 The table is established by the previously mentioned 

2 6 "one or more processor companies different from the prin- 

27 ter company". The table has an output dot-per-pixel 

28 structure that differs from the data structure within the 
2 9 pipeline. 

30 

31 The foregoing may represent a description or defini- 

32 tion of the first aspect or facet of the invention in its 

33 broadest or most general form. Even as couched in these 
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1 broad terms, however, it can be seen that this facet of 

2 the invention importantly advances the art . 

3 In particular, although the processor or "external 

4 RIP" is designed, manufactured, programmed and sold sepa- 

5 rately from the printer and although the printer is not 

6 specifically manufactured to print using any arbitrary 

7 output dot-per-pixel structure that may be favored by the 

8 designers, manufacturers and/or programmers of the proces- 

9 sor or "external RIP" — nevertheless the printer drop 

10 table can in fact be used to cause the printer to print 

11 using any such arbitrarily favored output dot-per-pixel 

12 structure. 

13 What this means is that the two-bit pipeline and drop 

14 table, in combination with the independent business ar- 

15 rangements described above, provide a remarkably potent 

16 tool for benefitting consumers while encouraging competi- 

17 tive, creative and constructive behavior on the part of 

18 processor companies. This benefit derives from enable- 

19 ment, by the data-structure conversion in the drop table, 

2 0 of an enormously broad range of data-interpretive capabil- 

21 ities. 

22 In particular this beneficial arm's-length relation- 
2 3 ship facilitates and encourages a healthy and beneficial 
2 4 competition between the processor companies and the prin- 
2 5 ter company . As noted above, the printer company may 

2 6 provide its own — or an affiliate's own — RIP which may 

2 7 even be internal to the printer, and this "internal RIP" 

2 8 may perform functions closely analogous to those of the 

2 9 processor companies. 

3 0 As a practical matter the printer company may also 

31 supply the necessary syntax, parametric information etc. 

32 in an instruction manual to essentially any qualified 

33 processor company that wishes to have them. Thus the 

34 invention provides in effect a collegial challenge to the 

Anton! Gil et al . / January 31, 2001 10 P. Lippman / PD-60003198 xHPZ-33 



1 processor companies. It opens the door, in an ingenious 

2 fashion, to external control of the detailed printing 

3 modes of the printer — and thereby to original thinking 

4 about ways to control the printer. 

5 

6 Although the first major aspect of the invention thus 

7 significantly advances the art, nevertheless to optimize 

8 enjoyment of its benefits preferably the invention is 

9 practiced in conjunction with certain additional features 

10 or characteristics. In particular, preferably the table 

11 is configured by instructions held or generated in the 

12 raster image processor; in this case, a subpref erence is 

13 that the table reside within the printer. 

14 Another main preference is that the system further 

15 include, in the processor, precooked printmask information 

16 and procedures; and in the printer, popup printmask infor- 

17 mation and procedures for refining precooked mask informa- 

18 tion from the processor. In this case a subpref erence is 

19 that the precooked and popup printmask information and 

2 0 procedures include nozzle-out error hiding; and also have 

21 a format that expressly defines which pass prints each 

22 pixel (as distinguished from provision of a discrete 
2 3 binary mask for each pass) . 

24 Another main preference, actually a set of alterna- 

25 tive preferences, is that the table output dot-per-pixel 
2 6 structure is mapped to the data structure within the 

27 pipeline substantially as shown in any of the alternative 

2 8 "dots /pixel out" columns: 

29 
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1 within dots /pixel out 

2 pipeline option 1 option 2 option 3 option 4 option 5 
300 0 0 0 0 0 

4 0 11 1 i ! 2 

510 1 1 2 3 5 

611 1 2 4 8 12 

7 

8 Although the system may as readily be configured to pro- 

9 duce the binary-value identity relationship tabulated 

10 earlier, it will be understood that such a structure 

11 confers little benefit that cannot be achieved without the 

12 drop table, and is accordingly relatively trivial here. 

13 Yet another main preference is that the system fur- 

14 ther include a computer for receiving or generating such 

15 image data, and transmitting such data to the processor. 

16 In this case, some subsidiary preferences are that: 
17 

18 " the computer also be for preprocessing such received 

19 or generated image data, preparatory to transmitting 
2 0 to the processor; 

21 

22 B in event the image is a color image, the system also 

23 include a monitor, associated with the computer, for 

24 viewing the image; and either the processor or the 

25 computer include at least part of a stage ( i . e. a 

26 processing stage) for reconciling colors viewed at 

27 the monitor with colors to be printed at the printer. 
28 

29 

30 In preferred embodiments of its second major inde- 

31 pendent facet or aspect, the invention is a method of 

32 providing a system for printing an image based on data. 

33 The printing is performed using a printer that is manufac- 

34 tured by a printer company, and has a native resolution. 
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1 As to this second aspect of the invention, and par- 

2 ticularly for purposes of the appended claims, provision 

3 of the printer is not a step of the inventive method as 

4 most broadly conceived. Rather, the printer is assumed to 

5 exist, and its provision is a step that is an element of 

6 the context or environment of the invention. 

7 (Thus the printer provision, in this method aspect of 

8 the invention, is somewhat analogous to the image data in 

9 the system aspect described earlier. The data and printer 

10 and the printer company — not being steps at all — are, 

11 for purposes of this method aspect, deemed elements of 

12 neither the invention nor its environment.) 

13 inventive method does include the step of manu- 

14 facture and of programming by one or more companies 

15 different from the printer company — of a raster image 

16 processor. The processor is for processing such data and 

17 transmitting the processed data to the printer. 

18 Another step of the method is provision, by those 

19 "one or more companies", of a portion of a two-bit data 
2 0 pipeline carrying the in-process data through at least a 

21 part of the processor. Yet another step is establishment, 

22 by the one or more companies, of a drop table for convert- 
2 3 ing the data from the pipeline to the native resolution. 

2 4 The table has an output dot-per-pixel structure that 

25 differs from data structure within the pipeline. 
26 

27 The foregoing may represent a description or defini- 

2 8 tion of the second aspect or facet of the invention in its 

2 9 broadest or most general form. Even as couched in these 

30 broad terms, however, it can be seen that this facet of 

31 the invention importantly advances the art. 

32 In particular, this method represents a portion of 

33 the effort involved in fabricating the system described 

34 above as the first aspect of the invention. Hence the 
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1 benefits of that system are attributable as well to the 

2 present method invention. 

3 All the steps of this method, as most broadly con- 

4 ceived, are performed by the processor companies. Their 

5 performance of these particular steps thus is the method 

6 covered by the corresponding ones of the appended claims; 

7 however, of course a processor company that performs these 

8 steps with respect to a printer owned by the owner of the 

9 present document is deemed to have an implied license 
1 0 hereunder . 

11 

12 Although the second major aspect of the invention 

13 thus significantly advances the art, nevertheless to 

14 optimize enjoyment of its benefits preferably the inven- 

15 tion is practiced in conjunction with certain additional 

16 features or characteristics. In particular, preferably 

17 the method further includes manufacture, by the printer 

18 company, of the printer. 

19 That is to say, whereas the method as most broadly 

2 0 conceived excludes fabrication of the printer, the method 

21 as here preferred includes that step. By definition, how- 

22 ever, this preferred method can be performed only by two 

2 3 different business entities that are in substance mutually 

2 4 unaffiliated (as described earlier in discussion of the 

2 5 first aspect of the invention) . 

26 The definition of this preference is stated here to 

2 7 clarify conditions involved in enforcement of the corre- 

28 sponding appended claims. In other words, this patent 

2 9 document is potentially enforceable against a pair of 

3 0 mutually unaffiliated business entities that respectively 

31 perform the two complementary parts of the method. 

32 Another basic preference is that the method also 

33 include interconnection of the processor and printer by an 
3 4 end-user independent of said companies. Thus again this 
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1 method can be performed only by a processor company and 

2 such an unaffiliated end-user, if they respectively per- 

3 form the complementary parts of this compound method. 

4 In this case, a subpref erence is that the method also 

5 include provision of a computer for preprocessing the data 

6 and furnishing the preprocessed data to the processor; and 

7 interconnection of the computer and processor. The latter 

8 step too is performed by the independent end-user. 
9 

10 

11 In preferred embodiments of its third major independ- 

12 ent facet or aspect, the invention is a method of provid- 

13 ing a system for printing an image based on data. The 

14 system uses a raster image processor manufactured and pro- 

15 grammed by one or more processor companies. 

!6 The processor has a portion of a two-bit data pipe- 

17 line carrying the data through at least part of the proc- 

18 essor. The processor also generates or holding instruc- 

19 tions for configuring a printer drop table. 

2 0 The preceding two introductory paragraphs establish 

21 the context for the method of the third aspect of the 

22 invention. This method as most broadly conceived thus 
2 3 excludes the portion of overall system fabrication and 

24 programming that is performed by the processor company or 

25 companies. The method itself is introduced below. 

2 6 The method includes the step of manufacture and 

2 7 programming, by a printer company — different from the 

2 8 processor company or companies — of a printer for receiv- 

2 9 ing the image data from the processor. The printer has a 

30 native resolution. 

31 The method also includes the step of establishment, 

32 by the printer company, of a drop table within the prin- 

33 ter. The table is for converting the data from the pipe- 

3 4 line into the native resolution of the printer. 
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The table has an output dot-per-pixel structure that 
differs from data structure within the pipeline. The 
table is configured by the instructions. 

The foregoing may represent a description or defini- 
tion of the third aspect or facet of the invention in its 
broadest or most general form. Even as couched in these 
broad terms, however, it can be seen that this facet of 
the invention importantly advances the art. 

In particular, this third aspect of the invention is 
complementary to the second aspect described earlier. 
That is, whereas the second aspect of the invention repre- 
sents the portions of an overall printer-plus-processor 
system fabrication that are performed by the processor 
company or companies, this third aspect represents the 
portions performed by the printer company and affiliates . 
Hence this third aspect too advances the same benefits 
described earlier for the first, system aspect of the 
invention . 

Although the third major aspect of the invention thus 
significantly advances the art, nevertheless to optimize 
enjoyment of its benefits preferably the invention is 
practiced in conjunction with certain additional features 
or characteristics. In particular, preferably the method 
also includes the step of manufacture and programming, by 
the one or more processor companies, of the processor. 

Again, as a mirror image of the first preference de- 
scribed above for the second aspect of the invention, this 
present preference represents the combination of all 
system fabrication steps performed by both parties or 
groups of parties. (In fact it is thus substantially 
identical in scope to that first preference of the second 
aspect) . 
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1 In this case a subpref erence is that the method also 

2 include interconnection of the processor and printer by an 

3 end-user independent of the companies . To the overall 

4 fabrication, this step thus adds assembly. 

5 Another basic preference is that the method also 

6 include the steps of providing a computer for preprocess- 

7 ing the data and furnishing the preprocessed data to the 

8 processor; and interconnecting the computer and processor. 

9 Both these steps are performed by the independent end- 
10 user. 

11 

12 In preferred embodiments of its fourth major inde- 

13 pendent facet or aspect, the invention is a printer for 

14 printing an image, based on input image data. The printer 

15 includes a plural -bit data pipeline capable of processing 

16 such data at more than one bit per pixel. 

17 The printer also includes an interface for accepting 

18 an externally defined drop table. The table converts 

19 plural-bit data from the end of the pipeline to a specific 

20 number of dots per pixel, preparatory to printing. The 

21 number of dots per pixel defined by the table may be 

22 substantially any integral value ( i . e . a number that is 

23 an integer) . 
24 

25 The foregoing may represent a description or defini- 

2 6 tion of the fourth aspect or facet of the invention in its 

2 7 broadest or most general form. Even as couched in these 

28 broad terms, however, it can be seen that this facet of 

2 9 the invention importantly advances the art. 

30 In particular, the drop table enables externally 

31 controlled configuration of a customized , specialized 

32 relationship between the standardized data structure 

33 within the pipeline and an essentially arbitrary hierarchy 

34 of printable tonal-value states. Such versatility in the 
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1 hierarchy of tone states is extremely valuable in accom- 

2 modating unusual requirements of special -purpose print 

3 media . 

4 Because the drop table is externally defined, this 

5 customized relationship can be imposed upon printer opera- 

6 tions — and can be changed at will — at any time even 

7 long after the printer itself is made. Therefore the 

8 printer system is enabled to serve needs of special print 

9 media that do not yet exist when the printer is designed 

10 and manufactured, as well as many niche media products 

11 that are known when the printer is made — but may not be 

12 sufficiently widespread in use to justify specific tonal - 

13 hierarchy design by the printer company. 
14 

15 Although the fourth major aspect of the invention 

16 thus significantly advances the art, nevertheless to 

17 optimize enjoyment of its benefits preferably the inven- 

18 tion is practiced in conjunction with certain additional 

19 features or characteristics. In particular, preferably 

20 the interface also accepts, in addition to the table: 
21 

22 ■ plural-bit image data from the end of the pipeline, 

2 3 and 

24 

2 5 "a specification of a printmode defining how such data 

2 6 should be printed. 

27 

2 8 In this case the number of dots per pixel defined by the 

2 9 table may be substantially any integral value less than or 

3 0 equal to a number of passes defined by the printmode. 

31 
32 
33 
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1 BRIEF DESCRIPTION OF THE DRAWINGS 

2 



3 Fig . 1 is a high-level block diagram of a system 

4 according to the invention, also effectively illustrating 

5 the interwoven business arrangements of the invention — 

6 and particularly including not only the processor (or 

7 "external RIP") that is integral to the invention but also 

8 another, optional "internal RIP"; 

9 Fig. 2 is an analogous diagram but at a somewhat 

10 higher conceptual level and representing in a different 

11 perspective some of the functions of the assembled system; 

12 Fig. 3 is a drop table illustrating a conventional, 

13 common binary relationship or mapping between a two-bit 

14 data structure and a two-pixel (actually two-subpixel) dot 

15 allocation or tonal hierarchy; 

16 Fig. 4 is a like drop table comparing: 
17 

18 ■ the Fig. 2 relationship — again, common binary, at 

19 resolution of 50x25 dots/mm (1200x600 dpi) — tabu- 
2 0 lated in units of dots or drops per unit cell at 

21 25x25 dots/mm (600x600 dpi) , with 

22 

2 3 "a much more highly generalized or abstract data-to- 

2 4 dot mapping (in this document familiarly called "true 

25 two-bit" and implemented at 25x25 dots/mm) that is a 

2 6 feature of the present invention; 

27 

2 8 Fig. 5 is a block diagram, with coordinated tabula- 

2 9 tion, illustrating the stages of a data -pipeline portion 

3 0 of the Fig. 1 system; 

31 Fig. 6 is a table illustrating several specific 

32 data/dot mappings within the generalized Fig. 3 mapping; 
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1 Fig. 7 is a drop table illustrating superpixel defi- 

2 nition for last-stage expression of a four-bit error- 

3 diffusion system; 

4 Fig. 8 is a like table but showing superpixel defini- 

5 tion in so-called "superpixel families", for four differ- 

6 ent permutations (identified as "0" through "3") of a 

7 four -bit system; 

8 Fig. 9 is a diagram illustrating use of a so-called 

9 "expansion matrix" for conversion from error-diffusion 

10 state to superpixel assignment (in an example converting 

11 from 12 dots/mm and three bits, to 25 dots/mm and two 

12 bits) ; 

13 Fig. 10 is a table illustrating a four-permutation 

14 superpixel definition (at 25x25 dots /mm) ; 

15 Fig. 11 is a pair of graphs that relate halftone 

16 value to "contone" (continuous tone) color tonal level, 

17 for a single-bit binary system and a two-bit system — and 

18 so illustrate a conceptual extrapolation of error diffu- 

19 sion from binary to multibit; 

20 Fig. 12 is a like set of graphs augmented by two 

21 additional, coordinated ones representing the contone 

2 2 functions themselves — they illustrate application of 

2 3 linearization curves and thresholds to multilevel error 

24 diffusion; 

25 Fig. 13 is a linearization curve for black — i . e . , 
2 6 a graph of linearized black vs. contone input, nine and 

2 7 eight bits per pixel respectively — and particularly 

2 8 representing a preferred embodiment that is part of a 

2 9 commercial product; 

3 0 Fig. 14 is a diagram like Fig. 4 but for the Fig. 1 

31 ink-limiting and plane-split stages (particularly repre- 

32 senting acquisition of the " factor " described in the 
3 3 associated text) ; and 
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Fig. 15 is a highly schematic diagram showing cyan 
(C) and magenta (M) separation in the Fig. 13 limiting and 
split stages. 



DETAILED DESCRIPTION 

OF PREFERRED EMBODIMENTS 

1. APPARATUS -MODULE AND BUSINESS-ENTITY INTERRELATIONS 

Preferred apparatus embodiments of the invention 
involve three major modules 113, 121E, 141 {Fig. 1), one 
of which can include an optional internal module 121N. Of 
these four units, two are parts of the environment of the 
invention, not elements of the invention itself as most 
broadly regarded: a computer 113 and an internal RIP 
121N. 

The remaining two units are elements of at least some 
of the previously introduced major apparatus aspects of 
the invention, again as most broadly conceived. These are 
the printer 141 {excluding its internal RIP 121N) and the 
processor or external RIP 12 IE. In addition, provision of 
one or the other of these two units 141, 121E is an ele- 
ment of at least one of the major method aspects of the 
invention . 

Essential to the objectives of any such system or 
method is existence of an image 111, which may be derived 
from a separate source and then pass through an entry 
mechanism 112 into the computer 113 {as suggested in Fig. 
1) . There an image is most typically subject to modifica- 
tion in a general -purpose microprocessor 114, 119E that 
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1 supports manually controlled image manipulations, using 

2 e - g- a mouse or keyboard (or both) 116 and guided by 

3 observation of the emerging image on a monitor 115 that is 

4 part of the computer. 

5 Alternatively the image may be developed as original 

6 art within the computer 113, using the manual input device 

7 or devices 116. In either event the operator may perform 

8 any of a great variety of operations on the image. 

9 Such operations usually range from near-mechanical 

10 processes such as cropping the image and scaling the 

11 resolution, through classical optical adjustments of 

12 brightness and contrast, to color transformations such as 

13 rotating the hue (in a polar-coordinate color space) and 

14 many other sophisticated effects. In addition the com- 

15 puter may be directed to perform certain automatic or 

16 semiautomatic operations such as correction 119E of output 

17 signals to reconcile — to the extent possible — known 

18 gamut divergences between the computer 113 and printer 

19 141. 

20 This latter color-correction module when within the 

21 computer 113 is typically intended to feed certain color 

22 paths that may lack their own such capability. This is 

23 true, for instance, of a route commercially known (for 

2 4 certain HP products) as a "Sleek" path 123 to the external 

25 processor 121E. 

2 6 Such a lack, however, is not a necessary feature to 

2 7 use of the color-correction block in the computer. Thus 

2 8 the hybrid "Turbo" path 151 feeds into the optional inter- 

2 9 nal RIP 121N even though the latter does have its own 

30 color-reconciliation block 119N — since this block in the 

31 internal RIP may lack sophistication needed for certain 

32 image or media characteristics. 
33 
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1 The Turbo route 151 has been here denominated a 

2 hybrid, only because it follows neither the purely 

3 external-RIP ("processor") strategy nor the purely 

4 internal-RIP strategy. The Sleek path 123, by comparison, 

5 is dedicated exclusively to the processor (external RIP) 

6 121E. 
7 

8 The Sleek path 123 is so named because (as will be 

9 seen) what enters the printer box 141 along that path — 

10 at its downstream end as the diagram demonstrates is 

11 more nearly ready to print, requiring little processing by 

12 comparison. What enters the printer 141 via the Turbo 

13 path 151 and other paths 117, 118 instead remains to be 

14 processed extensively, although the Turbo route 151 re- 

15 quires much less processing within the printer 141 than 

16 information in the other paths 117, 118. 

17 One reason for the difference in amount of processing 

18 required is that, in Hewlett Packard's implementations of 

19 such systems to-date, both the Sleek and Turbo routes 123, 

20 151 are devoted to bitmap (or so-called "raster") opera - 

21 tion. This characteristic is to be distinguished from the 

22 two language-based routes 117, 118 based respectively on 

2 3 Hewlett Packard Graphics Language 2® ("HPGL2"®) and on the 

2 4 Adobe PostScript® language — which are instead dedicated 

25 to vector-graphics processing. 

2 6 As is well known in this field, extensive very elabo- 

27 rate interpretation is required to print from image data 

28 supplied in the usually more-compact vector form. In fact 

2 9 such data must be expressed in bitmap form. 

3 0 If the data are in bitmap form initially, naturally 

31 they are much more nearly ready to instruct the printer 

32 final-output stage on a pixel -by-pixel basis as required. 
3 3 As will be seen shortly, however, certain processing that 
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1 is key to the present invention does remain downstream in 

2 all of these processing routes . 

3 

4 The processor 121E and the internal RIP 121N each do 

5 typically have their own ink-limiting and plane-split 

6 modules 12 6E, 12 7E — and 12 6N, 12 7N — respectively. In 

7 these blocks ink depletion is calculated to avoid excess 

8 ink deposition, and the cyan and magenta color planes are 

9 each split into two (light and dark, for each) in prepara- 

10 tion for plane-by-plane rendition 128E, 128N. 

11 This rendition may be conventionally performed for 

12 continuous -tone photo-like images by error diffusion as 

13 shown, or for commercial graphics and the like by dither- 

14 ing. Some other systems instead perform rendition in 

15 three-color space. 

16 Three-color rendition may be accomplished, merely by 

17 way of example, either by dithering on a color vector as 

18 described in a coowned patent of Alexander Perumal and 

19 Paul Dillinger, or on a device-state basis through precal- 
2 0 culated error-diffusion lookup tables as in another co- 

21 owned patent of Francis Bockman and Guo Li — or in other 

22 ways. The present invention is by no means limited to any 
2 3 particular rendition methodology. In the case of three- 

24 color rendition, the plane-split module 127E or 127N and 

25 the rendition block 128E or 128N are reversed in sequence. 
26 

27 At their downstream ends, all four data paths 117, 

2 8 118, 151, 123 converge via an interface block 136 that 

2 9 simply provides major alternative data buses 134N, 134E 

30 leading to a common bus 134. This common bus passes the 

31 rendered data to a printmasking stage 144, which prefera- 

32 bly but not necessarily adheres to the "reheated mask" 

33 paradigm introduced in the previously mentioned document 

34 of Garcia. 



1 When the Garcia principles are observed, the mask is 

2 most typically initiated as a "precook masking" kernel 

3 131N, 131E in the respective RIP. The kernel is passed at 

4 133N or 133E respectively and then a common path 133 to 

5 the mask-reheating stage 143 — which is custom-configured 

6 by nozzle-health data 142. 

7 The latter information is derived automatically, 

8 based upon actual test-pattern measurement feedback 147 

9 from the printer output stage 146. The nozzle data 142 

10 are made to modify the mask kernel pseudorandomly . 

11 More specifically, this is done in such a way as to 

12 approximately minimize adverse banding effects due to 

13 imperfect nozzle performance — but subject to balance 

14 against adverse granularity effects that can arise in 

15 highly randomized masking. All this is set forth at 

1 6 length in the Garcia document . 
17 

18 Now stepping back from the operational blocks it can 

19 be seen in the overview that the input image 111 ordi- 
2 0 narily has an inherent or native resolution as indi- 

21 cated along the bottom edge of the drawing. This resolu- 

22 tion may be subject to cautious definition in the case of 
2 3 vector data, but nevertheless at least conceptually does 

2 4 exist. 

25 In general, a different processing resolution pre- 

26 vails in the computer 113, and in those of the processor 

27 121E or internal-RIP 121N stages which precede the ink- 

28 limiting stage 12 6N or 12 6E . In the drawing this fact is 

2 9 suggested by markings along top and bottom edges, refer- 

30 ring to host processing resolution in the internal and 

31 external paths respectively. 
32 

33 A third processing "resolution" actually a resolu- 

3 4 tion analog but not truly a resolution, rather only an 
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1 abstract so-called "bit depth" is used in the portions 

2 of the system that begin with the ink- limiting 126N, 126E 

3 and end just within the reheated-mask stage 144. The bit 

4 depth is simply the number of bits per pixel. 

5 This resolution analog, again in general (though not 

6 necessarily) , is different from the resolution in the 

7 previous two stages. Specifically, the bit depth in these 

8 portions of the data transmission system or pipeline 

9 typically receives eight bits into the plane-split block 

10 127N, 127E. The halftoning block 128N, 128E reduces that 

11 from eight to usually and preferably two — but in some 

12 cases four. 
13 

14 Superpixeling carries the output to most preferably 

15 two data bits. A greater number of bits is possible, 

16 within the scope of certain of the appended claims. The 

17 highest and best use of the principles of the invention, 

18 however, is believed to be realized when the number of 

19 bits is two. 

2 0 Thus, even though a more-accurately broader percep- 

21 tion of the invention calls for speaking of "plural" data 

22 bits, in this document the data transmission system from 
2 3 either ink-limiting block 12 6N, 12 6E into reheated-mask 

2 4 block 144 is familiarly called the "two-bit pipeline". 
25 Finally the operating resolution is yet again in 

2 6 general (and most usually, though not necessarily) differ- 

27 ent in the final downstream operations. These begin just 

2 8 inside the reheated-mask module 144 and continue through 

2 9 the printer output stage 146 and onto the output hardcopy. 

30 Myriad details of the printer output stage 146 and 

31 its transfer of image content onto a printing medium are 

32 shown and discussed in the Garcia document and its cited 

3 3 precursors, all wholly incorporated into the present 
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1 document. It would be cumulative to repeat such a mass of 

2 description here. 

3 The resolution in the printer output stage 146 — and 

4 in portions of the reheated-mask stage 144 that follow a 

5 certain transition point is marked at bottom of the 

6 diagram as the "native printer resolution" . The transi- 

7 tion point itself is in essence the drop-table conversion 

8 module 145 a memory location, within the printer, that 

9 accepts data constituting a drop table . 

10 That module 145 thereby, as mentioned earlier, per- 
il forms a translation or mapping of data states within the 

12 two-bit pipeline 126-135 into a hierarchy of tonal states 

13 (or, equivalently , drop-placement patterns) in the output 

14 stage 146. It thus maps the two-bit (or other plural) 

15 data of the pipeline into the native printer resolution. 
16 

17 In order for the drop-table conversion 145 to func- 

18 tion, a conversion rule must in fact be explicitly speci- 

19 fied. In other words, some desired mapping must reside in 
2 0 the drop table block 145 explicitly. 

21 In most or all earlier systems this mapping has been 

22 in effect taken for granted, by virtue of being embedded 
2 3 (usually deeply) in fundamental, low-level system design. 
2 4 In the present invention, however, instead the mapping is 
2 5 expressly reserved for control either by engineering 

2 6 change or by aftermarket enterprise — as seen respec- 

2 7 tively in the "printmode definition" modules 132N, 132E of 

28 the internal RIP 121N and processor 121E. 

2 9 Thus these definition blocks 132N, 132E supply infor- 

30 ma tion by converging data paths 135N, 135E and then a 

31 common path 135 for storage within the drop table. In 

32 this way, configuring of the drop table 145 — very close 

3 3 to the intrinsic core of the printer data-structure con- 
3 4 figuration as well as mask reheating 143 is directly 



1 controlled by engineering redirection or aftermarket 

2 creativity manifested in the kernel and definitional 

3 blocks 131N, 132N and 131E, 132E respectively. 

4 These functions are shown with a somewhat different, 

5 functional emphasis in Fig. 2, which is believed to be 

6 self explanatory. The net effect is an invitation to 

7 processor vendors: 
8 

9 provide a 25 dot/mm, 2 bit/pixel, six-color 

10 plot file, define a printmode includ- 

H ing a precooked mask and drop table, 

12 and 

13 

14 the printer will print your plot — 

15 

16 in such a way that each of the four states 

1 7 represented by the two bits per pixel 

18 and color may correspond to any combi- 

19 nation of drops that you like, up to 

20 (at least) the number of passes that 

21 you define in the printmode. 
22 

23 The vendor has full control of the number of drops as- 

2 4 signed to each state within the pipeline — although as a 

2 5 practical matter the first state, zero, is very preferably 

2 6 translated as zero, i . e . maintained without modification. 

27 All of this redounds positively to the benefit of the 

2 8 end-user, who has a wide range of RIPs available for the 

2 9 printer. In particular the internal one has some clear 

3 0 advantages (ease of use, self-contained, well-tuned) and 

31 the external one having others (flexibility, job manage- 

32 ment, control over color profiles) . 
33 
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1 Preferred embodiments of the invention relate to 

2 three features that have now been described with reference 

3 to Fig. 1. One of these features is the provision of a 

4 masking kernel 131N, 131E, fed to the mask-reheat function 

5 143 in the printer 141 proper ( i . e. not in the internal 

6 RIP 121N) . 

7 A second of these features is configuring of the 

8 data-structure conversion by the definitional data 132N, 

9 132E, analogously fed to the drop table 145 also in the 
10 printer proper. 

H In particular when the kernel or definitional data, 

12 or preferably both, reside in the processor 121E — the 

13 external RIP at least one very deeply intrinsic perfor- 

14 mance parameter is, abruptly, controlled directly by 

15 manufacturing or programming personnel who are entirely 

16 outside the printer design and manufacturing functions. 

17 Thus it is necessary to call special attention to the 

18 third and perhaps most subtle of the three features, since 

19 it may otherwise pass unrecognized even though in a sense 
2 0 it may be the most extraordinary and striking. The very 

21 conversion of data at a fundamental structural level, from 

22 processing data to printer data, is controlled distribu- 

23 tively as between two business entities that are by defi- 
2 4 nition unaffiliated: 

25 

2 6 ■ the printer company, which is responsible for every- 

27 thing in block 141 except the contents of the drop 

28 table 145 and the starting point for operation of the 
2 9 masking function 143, 144; and 

30 

31 ■ the processor company, responsible for the processor 

32 12 IE and thereby the contents of the drop table and 

33 the kernel for reheating. 

34 
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1 Thus the invention permits the processor company to reach 

2 directly into the heart of the printer operation and 

3 control its pulse there. 

4 
5 

6 2. MODE OF CONTROL; THE "TRUE 2 -BIT PIPELINE" 

7 

8 This invention represents upgrades and refinements to 

9 a multilevel pipeline originally developed in the Hewlett 

10 Packard organization for a 50x25 dots/mm (1200x600 dpi) , 

11 binary swath format to 25x25 dots/mm (600x600 dpi) , 2 

12 bit/pixel swath format. This means that the system can 

13 address a plural number of drops onto a single cell, and 

14 that it is possible to choose among four different number 

15 of drops to print on each cell. 

!6 Although the same functionality can be achieved 

17 through other means in other HP products, a great advan- 

18 tage of the described method is that it can be fully 

19 configurable from external files — which can be created 
2 0 by HP engineers, third-party media vendors or even exter- 

21 nal software RIP vendors — thus allowing different num- 

22 bers of drops per pixel, depending on the ink and media 
2 3 types to be used. 

24 Other printers usually provide dedicated code depend- 

2 5 ing on the total number of drops to printed at each pixel. 

2 6 Halftoning and printmask generation processes must gener- 

27 ally be tuned for each special circumstance. 

28 The present invention, familiarly called the "True 2- 

2 9 Bit Pipeline", has as its main objective extraction of the 

30 greatest possible benefit from the two bits that are 

31 assigned to a 25x25 /mm cell at the printing stage. This 

32 is accomplished in part by reserving until the far end of 

33 the pipeline the functional decision of how many bits to 

3 4 print on each pixel. 
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1 Further, the decision itself is configurable through 

2 the printmode definition — but more remarkably through a 

3 programming language called "Var-Ware Plus", which HP 

4 provides in a fully documented package for use by RIP 

5 vendors. The printer thereby implements a function that 

6 uniquely, on a one-to-one basis, relates the alreadv- 

7 half toned value for each pixel to the number of drops that 

8 are going to be fired. This function as discussed earlier 

9 is manifested in the drop table. 

10 An advantage of the True 2-Bit pipeline is that it 

11 allows optimizing the pipeline for maximum image quality, 

12 and maximum robustness to banding and in the future 

13 other optimizations. These benefits can be permitted only 

14 by a multilevel, plural-bit pipeline, and two bits appear 

15 to represent a best- tradeoff compromise for flexibility, 

16 robustness and image quality. 

1 7 One bit per pixel does not provide room for robust- 

18 ness: while it does uniquely aim for maximum image qual- 

19 ity, it is very susceptible to banding. On the other 

20 hand, printing more than two bits per pixel (or allowing 

21 more than four different drop counts per pixel) may be a 

22 form of overkill that nevertheless provides no improvement 
2 3 in granularity. 

2 4 As an example, printing at 50x25 dot/mm, two bits, 

2 5 can provide very similar color depth and less granularity 

2 6 than 25x25, four bits while still handling the same 

27 amount of data. On the other hand, printing at 50x50, one 

2 8 bit, will yield best possible granularity, but will be 

2 9 much more susceptible to banding, and will show more 

3 0 variability from plot to plot. 

31 Finally, the True 2 -Bit pipeline is consistently 

32 linked to printmask generation techniques (particularly 

33 the Shakes regimen of Garcia) , which automatically adapt 

34 to the drop table that has been defined for that particu- 



Antoni Gil et al . / January 31, 2001 



31 



P. Lippman / PD-60003198 xHPZ-33 



lar plot. Actually, the same precooked mask can be used, 
regardless of the maximum number of drops that we define 
for a printmode. 

It is in the "cooking" (or "reheating") stage that 
the drop-table information is taken into account. The 

word "true" is used to symbolize the generality of the 
system — i . e. , that the system can implement any desired 
structure of four different drop counts although it is 

very highly preferable that the first one always be zero. 

Examples include [0, 1, 1, 2], [0, 1, 2, 4], 
[0, 1, 3, 8], etc., and for backward compatibility even 
[0, 1, 1, 1] . In contrast, without the drop table the 

four states transmitted from the dithering (and 

superpixeling) stage would uniquely mean [0, 1, 2, 3] 

drops . 

The True 2-Bit Pipeline can be conceptualized as part 
of a parallel process. On one side, the image to be 
printed is processed, and on the other the printmasks are 
prepared for that specific point in time, taking printhead 
nozzle health into account as described earlier. The 
present document relates to the former aspect, while the 
latter is disclosed in the earlier Garcia document and 
other sources which it cites . 



3. DEVELOPMENT HISTORY 

This pipeline is one of HP' s first to provide plural- 
bit error diffusion and multilevel printing. 

A preliminary basic product definition specified 
50x25 dots/mm. This specification made two bits available 
for each cell considered at the coarser resolution of 
25x25 dots/mm i . e . one bit for each of two drops that 
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1 would be printed at 50x25 — and these two bits allowed 

2 encoding of the information in the table of Fig. 3. 

3 Rendering at 50x25 dots /mm, however, is very seldom 

4 done. For best use of existing refined subsystems, it was 

5 desirable to render at 25x25, two bits per pixel, and then 

6 for printing reorganize the data into 50x25. It was deci- 

7 ded to enable both 50x25 and 25x25, at two bits. 

8 For halftoning, a particular goal is to deliver 

9 printing data at 25x25 dots/mm and two bits per pixel. 

10 Another objective is an ability to print continuously 

11 which can be accomplished by rendering one plot at the 

12 same throughput with which it is later printed, so that 

13 the printer can print one job and render another one in 

14 parallel. 

15 To do so in productivity and economy modes, it is 

16 necessary to halftone at a lower resolution. That is, if 

17 the system rendered to 12x12 dots /mm and half toned at that 

18 resolution, throughput would be accelerated by a factor of 

19 four — but with a resulting problem, namely the evident 
2 0 loss in resolution. 

21 For an imaging product as distinguished from a 

22 vector-drawing product, resolution usually or almost 

2 3 always is less important than maintaining color depth. 

2 4 That is, the system must be able to distinguish among a 

2 5 sufficient number of tonal levels within each cell and, 

2 6 if this constraint is observed, then a half toned image at 

27 12x12 dots/mm and three bits per pixel may not show a 

2 8 significant degradation in image quality as compared with 

2 9 25x25, two bits. 

30 The situation was different for earlier one-bit (pure 

31 binary) printers, in which 12x12 dots/mm was significantly 

32 worse than 25x25. In order to adapt the 12x12 three-bit 

33 format into the 25x25 two-bit that the printing pipeline 

3 4 expects, the superpixel concept was introduced. 
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1 Superpixeling expands the resolution of the printed 

2 image, from whatever has been delivered by the halftoning 

3 algorithms to the 25x25 and two bits required by the 

4 printing pipeline. At the same time, the bit depth is 

5 decreased. 

6 An additional consideration is the desirability of 

7 upgrading a system from four to six printheads . Such 

8 enhancement requires the capability to split the cyan (C) 

9 and magenta (M) planes into a total of four: dark and 

10 light cyan (C and c) , and dark and light magenta (M and m) 

11 — and at the same time ink limiting must be considered. 

12 In preferred embodiments, this process has been implemen- 

13 ted upstream from the halftoning stage. 
14 

15 

16 4. THE ABSTRACTION OF THE "TRUE" 2-BIT PIPE 

17 

18 In addition to all the above-introduced consider- 

19 ations, a further advantage of the two bits per pixel can 
2 0 also be taken if they are not associated with any particu- 

21 lar way of printing. This abstract concept is represented 

22 in the table of Fig. 4. 

23 As there shown, the four different two-bit combina- 

2 4 tions can be used to configure four different states, when 

2 5 the number of drops per 25x25 dot/mm cell is considered. 

2 6 Advantageously and very preferably, although in purest 

2 7 principle not necessarily, the only restrictions at this 

2 8 abstract level are that (1) the first level actually 

2 9 translate into zero, and (2) the number of drops at the 

30 four levels in sequence form a monotonic pattern: 
31 

32 0 < A < B < C. 

33 
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1 This "true 2 -bit pipeline" concept represents a very 

2 useful and surprisingly powerful abstraction. In this 

3 system all the data are processed in abstract terms 

4 purely bits and states . Only at the very end of the 

5 process does the system then impose the correspondence be- 

6 tween states and number of drops (Fig. 5) . 

7 The remainder of this discussion explores the illus- 

8 trated system. It has been found that greater clarity 

9 dictates arranging the explanation in reverse order of the 

10 sequence of modules — i . e. from back to front. As will 

11 be seen, each downstream block naturally demands a certain 

12 input format, and these demands in turn provide a natural 

13 explanation for the structure of the previous block. 
14 

15 

16 5. THE DROP TABLE 

17 

18 At this near-final stage, the image is almost ready 

19 to print. The printing mechanism output stage is in 

20 essence like various other printer heads on a scanning 

21 carriage: in a plural -pass printmode, it passes a certain 

22 number of times over every row of pixels. 

2 3 If the system is using a printmode having a number N 

24 of passes, then it has N chances to print a drop on each 

25 pixel. Unlike other HP inkjet printers, however, this 

2 6 system can take advantage of these N chances repeatedly — 

2 7 and thereby can print more than one drop per pixel. 
2 8 The masking pipeline disclosed in earlier Garcia 

2 9 documents, along with the true 2-bit pipeline introduced 

3 0 here, provides a solution for printing any number of drops 

31 per pixel. In preferred embodiments, now at this more 

32 practical level, an additional restriction is desirable — 

33 namely, that the maximum number of drops, C, be equal or 
3 4 smaller than the number of passes, N. 



35 



P. Lippman / PD-60003198 xHPZ-33 



1 With this in mind, one very important decision is how 

2 many drops of each primary color to use . Because the 

3 system is a "true 2-bit pipeline", the drop table can be 

4 designed like any of examples in the table of Fig . 6 . 

5 The table gives meaning to the superpixel definition 

6 that will be chosen. 
7 

8 

9 6 . SUPERPIXELING 

10 

11 Next proceeding upstream or "backward" from the drop 

12 table, in Fig. 5: superpixeling is the last stage of the 

13 halftoning pipeline. The superpixels are basically in- 

14 tended to interface from any resolution that comes from 

15 the error-diffusion process, into the 25x25 dots/mm, 2 

16 bits/pixel, that will feed into the final output-stage 

17 print engine. 

18 Superpixels are defined for resolution values of 6, 

19 12 and 25 dots/mm (150, 300 and 600 dpi). The 25 to 25 
2 0 dot/mm conversion is essentially an identity, while dis- 

21 cussion of the 6 to 25 dot/mm conversion begins to be 

22 confusing. 

23 Therefore this discussion will first examine the 12 

2 4 to 25 dot/mm case, as the best example to use. The 25 to 

25 25 dot/mm case will also be presented later. 
2 6 A first consideration is what drop table is in use. 

27 If it is [0 1 1 2] , which is a preferred default table in 

2 8 a present product, then in this case, we have four possi- 

2 9 ble inputs in other words, independent-variable values 

30 to the table (0, 1, 2 and 3) but "1" and "2" both 

31 translate into the same output: they both correspond to 1 

3 2 drop . 

33 Therefore, input state "2" will be unused in the 

34 superpixel definitions. The superpixels from 12 to 25 
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1 dots/mm represent that, for any given code that applies to 

2 a 12x12 dot/mm cell, codes to the corresponding four 25x25 

3 dot/mm cells must be assigned. 

4 Because it has been decided to print a maximum of two 

5 drops per 25x25 dot/mm cell, we can only find a maximum of 

6 eight drops per 12x12 dot/mm cell . Error diffusion deliv- 

7 ers 12x12 dots/mm, four bits (therefore, sixteen states) , 

8 but only eight different states will be defined. 

9 The eight states will correspond to [01234568] 

10 drops. (At least in principle a greater number of states 

11 can be defined, though some of these may correspond to a 

12 fractional number of drops. A coowned patent in the name 

13 of Ronald A. Askeland deals with implementation of frac- 

14 tional drops.) 

15 As a start, one may adopt the assignment between 

16 error-diffusion ("ED") states and superpixels appearing in 

17 Fig. 7. Here the ED states "1XXX" are equivalent to state 

18 0111, and are not used in this particular implementation 

19 because it has been decided to use only eight states. 

20 They could be used, at the designer's choice, by following 

21 the same principles here explained. 

22 As illustrated, a different entry to the drop table 

23 is defined for every 25x25 dot/mm cell: the 2x2 space 

2 4 inside the 12x12 dot/mm cell that was rendered is defined 

25 at a 25x25 dot/mm resolution. We see that 0, 1 or 3 is 

2 6 used in every 25x25 cell, which will correspond to 0, 1 

2 7 and 2 drops respectively. As a result, the two-by-two 

2 8 array of 25x25 cells totals the number of drops depicted 

2 9 in the bottom row. 

3 0 Because only color depth is under consideration, the 

31 definition of each individual drop inside the 12x12 cell 

32 is completely arbitrary. Whatever solution is chosen, 

3 3 there is a risk of creating patterning in event the same 

3 4 superpixel is tiled all over an area. 



Antoni Gil et al. / January 31, 2001 37 p. Lippman / PD-60003198 xHPZ-33 



1 To minimize the chances for patterning, two new 

2 concepts are used: the superpixel family and the 

3 superpixel expansion matrix . Instead of defining a single 

4 superpixel with a given number of drops, four will be 

5 defined. 

6 The four superpixels that contain the same number of 

7 drops and that, therefore, have equivalent color depth, 

8 will be referred to as a superpixel family . A coowned 

9 patent in the name of Ronald A. Askeland introduces the 

10 like concept of colorimetrically equivalent superpixels. 

11 Every member in the family will be referred to as a p ermu- 

12 tation . The superpixel families are organized as shown in 

13 the table of Fig. 8. 

14 Now the objective has become to choose one superpixel 

15 permutation per 12x12 dot/mm cell. The error-diffusion 

16 state only points to the proper superpixel family, since 

17 any member of the family has the same color depth, and is 

18 therefore a valid implementation for that given ED state. 

19 in order to actually choose the permutation for a 
2 0 given 12x12 dot/mm cell, a procedure familiarly called 

21 "lottery matrix" will be used. This is the more formally 

2 2 denominated Superpixel Expansion Matrix . 

2 3 The matrix is defined as a function of the pixel 

2 4 location. The design criterion is that, if ED delivers 

2 5 the same state in a wide area, then the system will always 

2 6 have to select a superpixel from the same family. 

27 Permutations will then be selected, with a noise 

2 8 characteristic that is pleasant to the eye — specif i- 

2 9 cally, that minimizes granularity. Different algorithms 

30 can be used for expansion-matrix design: 

31 It is possible to begin from a blue-noise matrix, or 

32 generate a fuzzy mask with the Shakes procedures, or just 

3 3 make the matrix manually. It is also possible to choose 
34 equally among all the permutations — that is, to use each 
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1 permutation one-quarter of the time — or to use them in 

2 different proportions . 

3 Finally, it is possible to choose a small matrix or a 

4 large one. A larger matrix will show less patterning, but 

5 require more system memory. Fig. 9 provides an example of 

6 how it all works together, when the above superpixel 

7 definition is applied. 
8 

9 As noted earlier, it remains to document the 25 

10 dot/mm to 25 dot/mm superpixel family (Fig. 10) . It can 

11 be considered an identity, and is uninteresting. 

12 This time the application goes from a 25x25 dot/mm 

13 cell to a 25x25 dot/mm cell. The present inventors advise 

14 against use of superpixel families that average a noninte- 

15 gral number of drops, as increased granularity results. 
16 

17 

18 7. HALFTONING 

19 

20 The stage that feeds superpixeling is the halftoning 

21 algorithm. A preferred algorithm for use with the present 

22 invention is error diffusion. 

2 3 Error diffusion is very well known in this field. It 

2 4 was originally conceived as a way to transform data from 

2 5 multibit to binary (that is, single-bit) . As an example 

2 6 consider an area fill, defined at 25 dots/mm, 8 bits per 

27 pixel. The whole area has the same value: tonal level 

2 8 130 (in a conventional scale from zero through 255) . 

29 The only available choice is between firing a drop on 

30 a given pixel location or not firing it. If the input 

31 value is 0, then the system refrains from firing (0) . If 

32 instead the input value is 255, then the system fires (1) . 

33 If the input value is somewhere in between, then the 

34 system goes to the closest point, but it has committed an 
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error; therefore it must try to commit the error in the 
inverse sense when moving to the neighboring pixels. 

In the example, tonal value for the first pixel is 
130. This is closer to 255 than to 0, so the system 
decides to fire (1). It has committed an error of +125, 
that it must then distribute among the neighbor pixels. 

Assume that the next pixel receives a fourth part of 
the error of the previous pixel (that is, -31 counts) . 
Then, the system must calculate that the second pixel has 
a value of 130 - 31 = 99. This total input value of 99 is 
closer to 0, so the system decides not to fire (0) — but 
thereby it commits an error of -99, that in turn it must 
propagate to the surrounding pixels (some of which will 
also receive error from the first pixel) . This process 
proceeds through hundreds of thousands, or millions, of 
iterations to complete an image . 

To fit this algorithm into the present invention, a 
few modifications are required. These are explored in the 
two subsections below. 

( a > Multilevel error diffusion: thresholds — A 
first step is to conceive of a way to implement the binary 
outcome of classical error diffusion into a multievent 
(i ■ e • multibit) outcome. That is, it is no longer a 
binary decision between firing or not firing a drop, but 
rather which superpixel family to choose. 

If the system is halftoning at 25 dots/mm, two bits, 
we'll have four superpixel families to choose among. The 
concept must be scalable to 12 dots/mm at four bits (six- 
teen superpixel families) — and even further, to six 
dots/mm, four bits. 

Fig. 11 shows how the error diffusion algorithm can 
be expanded from binary to multibit. At the same time, 
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1 the output value has been decoupled from the actual number 

2 of drops being fired. 

3 The graphs show how the con tone input can be divided 

4 into a number of regions equal to 2n - 1 , corresponding to 

5 n bits per pixel at the output. Besides the two natural 

6 thresholds, which are 0 and 255, new thresholds appear: A 

7 and B. 

8 Using this strategy, input values that are closer to 

9 A generate an output to superpixel ("SPX") family 01; 

10 those closer to B will be assigned to SPX 10, and so on. 

11 Errors propagate in the classical way described above. 

12 This explanation is the real picture for a 2 bit/pix- 

13 el output, easily expanded to 4 bit/pixel or whatever is 

14 required. Although Fig. 2 shows the ED thresholds A and B 

15 equally spaced from 0 and 255, because of linearization 

16 considerations this relationship is not maintained. 
17 

18 (b) Linearization — The classical ED algorithm was 

19 originally conceived for monitor screens. On a monitor 
2 0 screen each pixel is clearly bounded, and never overlaps 

21 with the surrounding pixels. These constraints facilitate 

22 good linear response of the algorithm. 

23 In Inkjet printing, however, the printed drops do 

2 4 overlap. The macroscopic result is, that error diffusion 

25 is no longer linear. 

2 6 It is accordingly widely known in this field that a 

2 7 linearization file should be created. The linearization 

28 file is applied to the continuous- tone information in 

2 9 advance of ED processing (Fig. 12) . 

30 The composite of the two functions linearization and 

31 error diffusion is supposed to be the identity so that 

32 a linear contone gradient still comes out linear, once 

33 half toned. In addition, because the linearization curve 

34 may assign a single image tone to different consecutive 

Antoni Gil et al . / January 31, 2001 41 P. Lippman / PD-60003198 xHPZ-33 



1 inputs and thereby create contouring, the linearization 

2 function also transforms the data from eight bits to nine. 

3 This transformation minimizes the contouring effect. 

4 The graphs also show how the intermediate thresholds 

5 A, B are not evenly spaced relative to 0, 255: their 

6 spacing too contributes to the linearization process. 

7 Also evident is that the linearization curve is the main 

8 contributor in lower- tone regions (0 to A) , whereas it is 

9 practically a straight line as the different thresholds 

10 approach more closely (A to B, B to 255) . Therefore when 

11 the system halftones at 25 dots/mm at four bits, most of 

12 the linearization work can be done through the threshold 

13 definition. 
14 

15 (c) Linearization and threshold examples — Finally, 

16 the result for a real case in a preferred embodiment (with 

17 drop table of [0 1 1 2] at 25 dots /mm, two bits) will be 

18 helpful for clearer understanding (Fig. 13) . This repre- 

19 sents a current Hewlett Packard product. 
20 

21 

22 8. INK LIMITING AND PLANE SPLIT 

23 

2 4 (a) Overview — Based on the foregoing understand- 

2 5 ings of how ED works, the next step upstream in Fig. 5 is 

2 6 to consider feeding of data into the ED. This system is 

2 7 using plane -independent error diffusion meaning that no 

2 8 consideration is made, when deciding about one color, of 

2 9 decisions already made for other colors. 

30 In the product which is a preferred embodiment, 

31 error-diffusion processing proceeds alternatively left to 

32 right and then right to left along consecutive rows. The 

33 printheads are six in number KCMYcm while the input 

3 4 files are always KCMY (once they have gone through the 
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1 color pipeline, which may transform them from RGB to 

2 KCMY) . 

3 In design of this system there were several choices 

4 concerning the ideal point at which to split the cyan and 

5 magenta planes between dark and light inks . It was de- 

6 cided to split before halftoning, and thus to pass six 

7 independent planes of data into the error diffusion stage. 

8 The split between dark and light inks is not trivial, 

9 in particular because there are different combinations of 

10 dark and light ink delivering the same color, but not the 

11 same total amount of ink. In other words, the plane-split 

12 process must be ink-dependent. 

13 Therefore, it is a good point at which to perform ink 

14 limiting. The main disadvantage of this process is that 

15 it operates at pixel level, not object level. 

16 In other words, if there is a large solid area of the 

17 same color, the system must still repeat the same opera- 

18 tion for each pixel, even though it must always yield the 

19 same result. This feature compels design of an algorithm 
2 0 that gives a good tradeoff between image quality and 

2 1 throughput . 
22 

23 (b) Depletion algorithm — We may distinguish three 

24 stages in the ILPS (ink-limiting and plane-split) process 

25 (Figs. 14 and 15) . First, it is necessary to determine 

2 6 how much ink is to be fired onto the particular pixel be- 

27 ing processed. 

2 8 Because of all the configurable parameters throughout 

2 9 the halftoning pipeline (linearization, thresholds, 

3 0 superpixel families, and drop table) , it would be impossi- 

31 ble to predict the ink usage based on only the values of 

32 the input image. Therefore for each channel a lookup 

3 3 table (LUT) must be built to associate the channel value 

3 4 to the ink usage. 
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1 For a given pixel, the process starts by retrieving 

2 the total amount of ink for that pixel (four LUT accesses 

3 and an addition) . Then, if the total amount of ink is 

4 larger than a predetermined maximum permissible ink value, 

5 the system must force the inking to that maximum value. 

6 This supposes a reduction in the total amount of ink, 

7 which must be redistributed to each individual channel . 

8 In simplest principle, each channel should receive one 

9 quarter of the permissible maximum. 

10 In reality, however, the black channel is the least 

11 affected by ink limiting, and the remaining ink must be 

12 distributed among CMY . The number that tells what ink 

13 reduction applies to each channel is called the "factor". 

14 This factor will directly multiply the channel value 

15 for black and yellow, and will point to a specific combi- 

16 nation of light/dark cyan or magenta. In other words, 

17 while the black and yellow channels don't undergo much 

18 further processing (their values are multiplied by factor K 

19 and factor y respectively, and actually factor K = 1) , the 

20 cyan and magenta still have another step to go. 

21 That step relates to so-called separat ion curves . 

22 These exist in pairs: one for dark and another for light 

23 color (for either C or M) . Also there is one pair per 

24 factor (that is, 256 pairs of M, and 256 pairs of C sepa- 
2 5 ration curves) . 

2 6 Thus it is necessary to pick the channel value for C 

2 7 or M, plus its respective factor. This will point to two 

2 8 values, one for the light ink and the other for the dark. 

29 
30 

31 9. ADDITIONAL FUNCTIONALITY 

32 

33 The ink-limiting and plane-split algorithm is the 

34 first one in the halftoning pipeline. This block is 
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1 accessible from different paths: HPGL2 , PostScript and 

2 Turbo . 

3 The Turbo path is a continuous -tone format satisfying 

4 two different HPGL2 specifications: "CRD-7" for raster 

5 data with a customized number of pixels; and "RTL" for 

6 raster data at one bit per pixel and color plane. Both 

7 are used by a system known as "OM" or "PipeOM" which is 

8 a pipeline for open media, and also is the one that the 

9 software RIPs are supposed to use. 

10 The printer receives this file format through the 

11 Var-ware print manager. This manager performs pixel 

12 replication if the input file is smaller than the output. 
13 

14 
15 

16 The above disclosure is intended as merely exemplary, 

17 and not to limit the scope of the invention — which is to 

18 be determined by reference to the appended claims. 
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